METHOD AND SYSTEM FOR COMPRESSING MOTION IMAGE INFORMATION 



Background of the Invention 

Field of the Invention 
5 The present invention relates to a method and system for 

compressing motion image information data by means of 
predictive coding with a high compression ratio and with high 
image quality. 
^ Description of the Related Art 

i; l0 In image signal transmission, an image signal is first 

*: J converted to another signal and then coded by assigning proper 

(r;. codes selected according to the statistical feature of the 

converted signal. When the image has high redundancy within a 
frame as is the case with an image including a regular pattern 
£5 or a plain image, there is a high correlation between adjacent 
;5 pixels, and thus it is possible to predict, to a certain 

degree, a pixel value to be coded next from a pixel value which 
has already been coded. Therefore, if components which could 
not be predicted are extracted, and the coding is performed 
20 only for these extracted components, it becomes possible to 
compress information with a large compression ratio. This 
technique is called the predictive coding. 

In the case of a motion image in a video telephone or the 
like, images of adjacent frames are very similar to each other, 
2 5 and thus the temporal change is limited. Such temporal 

redundancy can be removed by means of interframe predictive 



coding on the basis of interframe prediction. In this case, a 
block code is generally employed in which one codeword is 
assigned to one symbol, and one frame is divided into a 
plurality of pixel blocks so that the luminance difference 
within each block becomes smaller than within the entire frame. 
The smaller luminance difference within each block allows 
compression of information. This technique is called block 
coding . 

Entropy coding is known in the art as a coding technique 
which achieves data compression by assigning a high efficiency 
code to the converted signal. Huffman coding is known as a 
method for generating a high efficiency code. A representative 
example of the high efficiency code is an arithmetic code in 
which a probability numeric line is divided into segments in 
accordance with the occurrence probability of a symbol system, 
and a binary decimal number indicating a location in a segment 
is employed as a code for the symbol system. Codewords are 
generated one by one by performing the arithmetic process 
described above. 

A 3 -step block coding system is known in the art as a 
technique for coding an image signal in an efficient manner. 
This technique consists of 3 steps: sampling; conversion; and 
quantification. In this technique, in order to retain a two- 
dimensional resolution and high-frequency components of a given 
image signal, it is generally required to perform sampling at a 
frequency twice the highest frequency component . 



However , in the conventional image signal compression 
technique, because of the complexity of the block coding 
process, it is difficult to achieve both a high compression 
ratio and a high speed in the predictive compression coding of 

5 image data or audio data. 

When differential information is compressed in the motion 
image compression process, that is, when successive values Al 
and A2 are predicted to be similar to each other and when the 
value Al is known before the value A2 occurs, the difference A2 

0 - Al is regarded as having a value near 0, and compression is 
performed using the conventional Huffman code or arithmetic 
code. However, if Al and A2 can each take one of values 0, . . ., 
n, the difference A2 - Al can have one of 2n + 1 values. As a 
result, it is required to prepare 2n + 1 Huffman codewords, 

5 However, A2 can actually take one of n values, and thus n codes 
are not used from the local point of view. This means that the 
code includes a large amount of redundancy. Furthermore, when 
a difference between frames is great, significant degradation 
in image quality occurs, and a high-quality image cannot be 

0 obtained. 

In view of the above, it is an object of the present 
invention to provide a method and system for compressing data 
such as image information or audio information by means of 
predictive coding with a high compression ratio while 
5 maintaining high image quality. 
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Summary of the Invention 



According to an aspect of the present invention, to 
achieve the above object, there is provided a method of 
5 compressing motion image information, comprising the steps of: 
comparing pixels in a frame with corresponding pixels in a 
spatially or temporally adjacent frame and generating 
differential information in accordance with the comparison 
: ,1 result; generating and storing a 1-bit bit map indicating 
10 whether the differential information is greater or not greater 
ij than a given parameter; and compressing information of a pixel 
indicated as being greater than the parameter thereby reducing 
ff redundant information between frames, the method being 

characterized in that: an image in each frame is divided into 
'.15 blocks in advance, and each of all blocks is approximated by 
~Z (replaced with) a single plane defined by three data 

representing the magnitude of a pixel value in the block, the 
block-to-block gradient of the pixel value in an x direction, 
and the block-to-block gradient of the pixel value in a y 
20 direction. 

According to another aspect of the present invention, to 
achieve the above object, there is provided a method of 
compressing motion image information, comprising the steps of: 
comparing pixels in a frame with corresponding pixels in a 
25 spatially or temporally adjacent frame and generating 

differential information in accordance with the comparison 
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result; generating and storing a 1-bit bit map indicating 
whether the differential information is greater or not greater 
than a given parameter; treating (deleting) information of a 
pixel, indicated as being not greater than the parameter, as a 

5 pixel having no difference between frames; and compressing 
information of a pixel indicated as being greater than the 
parameter, the method of compressing image information being 
characterized in that: an image in each frame is divided into 
blocks in advance, and each of all blocks is approximated by 

0 (replaced with) a single plane defined by three data 

representing the magnitude of a pixel value in the block, the 
block-to-block gradient of the pixel value in an x direction, 
and the block-to-block gradient of the pixel value in a y 
direction. 

5 According to still another aspect of the present 

invention, to achieve the above object, there is provided a 
method of compressing image information, by means of comparing 
spatially or temporally adjacent pixels to each other and 
generating differential information so as to reduce redundant 

0 information between frames, the method including the steps of: 
comparing corresponding pixels to each other between frames and 
generating and storing a 1-bit bit map indicating whether the 
absolute value of the difference thereof is greater or not 
greater than a given parameter; and compressing information of 

5 a pixel indicated as being greater than the parameter thereby 
reducing redundant information between frames, the method being 
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characterized in that: an image in each frame is divided into 
blocks in advance, and each of all blocks is approximated by 
(replaced with) a single plane defined by three data 
representing the magnitude of a pixel value in the block, the 
5 block-to-block gradient of the pixel value in an x direction, 
and the block-to-block gradient of the pixel value in a y 
direction . 

According to still another aspect of the present 
invention, to achieve the above object, there is provided a 

0 method of compressing image information, by means of comparing 
spatially or temporally adjacent pixels to each other and 
generating differential information so as to reduce redundant 
information between frames, the method including the steps of: 
comparing corresponding pixels to each other between frames and 

5 generating and storing a 1-bit bit map indicating whether the 
absolute value of the difference thereof is greater or not 
greater than a given parameter; treating (deleting) information 
of a pixel, indicated as being no greater in the absolute value 
of the difference than the parameter, as a pixel having no 

0 difference between frames; and compressing information of a 

pixel indicated as being greater than the parameter, the method 
of compressing image information being characterized in that: 
an image in each frame is divided into blocks in advance, and 
each of all blocks is approximated by (replaced with) a single 

5 plane defined by three data representing the magnitude of a 
pixel value in the block, the block-to-block gradient of the 
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pixel value in an x direction, and the block-to-block gradient 
of the pixel value in a y direction. 

Preferably, the 1-bit bit map information stored in the 
bit map is compressed by means of a binary image coding method 

5 such as a run length, modified READ (MR, MMR) , modified Huffman 
(MH) , or JBIG coding method. 

Furthermore, information of a pixel indicated as being 
greater in the absolute difference value than the parameter is 
preferably compressed by means of an adaptive Huffman coding 

0 process including as many Huffman tables as the amount of 
predicted information . 

According to still another aspect of the present 
invention, to achieve the above object, there is provided a 
system for compressing motion image information, including 

5 entropy coding means or circuit for reduces redundant 

information between frames by means of comparing spatially or 
temporally adjacent pixels to each other and generating 
differential information, the system including: bit map 
information storage means or circuit for comparing pixels t and 

0 corresponding pixels t-1 to each other between frames and 

generating and storing a 1-bit bit map indicating whether the 
absolute value of the difference thereof is greater or not 
greater than a given parameter; and information compression 
means or circuit for compressing information of a pixel 

5 indicated, by the bit map stored in the bit map information 
storage circuit, as being greater in the absolute difference 
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value between pixels t and t-1 than the parameter, the system 
for compressing motion image information being characterized in 
that: an image in each frame is divided into blocks in advance, 
and each of all blocks is approximated by (replaced with) a 
5 single plane defined by three data representing the magnitude 
of a pixel value in the block, the block-to-block gradient of 
the pixel value in an x direction, and the block-to-block 
gradient of the pixel value in a y direction. 

According to still another aspect of the present 
10 invention, to achieve the above object, there is provided a 
. j system for compressing motion image information, including 
: , entropy coding circuit for reducing redundant information 
.J between frames by means of comparing spatially or temporally 

adjacent pixels to each other and generating differential 
'tS information, the system including: bit map information storage 
;~ circuit for comparing pixels t and corresponding pixels t-1 to 
each other between frames and generating and storing a 1-bit 
bit map indicating whether the absolute value of the difference 
thereof is greater or not greater than a given parameter; and 
20 information compression circuit which treats (deletes) 

information of a pixel indicated, by the bit map stored in the 
bit map information storage circuit, as being not greater in 
the absolute difference value between pixels t and t-1 than the 
parameter, and which compresses information of the other pixels 
25 indicated as being greater in the absolute difference value 
than the parameter, the system for compressing motion image 
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information being characterized in that: an image in each frame 

is divided into blocks in advance, and each of all blocks is 

approximated by (replaced with) a single plane defined by three 

data representing the magnitude of a pixel value in the block, 
5 the block-to-block gradient of the pixel value in an x 

direction, and the block-to-block gradient of the pixel value 

in a y direction. 

Preferably, the 1-bit bit map information stored in the 
:.i bit map information storage circuit is compressed by means of a 
||0 binary image coding method such as a run length, modified READ 
JI (MR, MMR) , modified Huffman (MH) , or JBIG coding method. 
}r : Preferably, the information compression circuit for 

compressing information of a pixel indicated as being greater 
; r :t in the absolute difference value than the parameter performs 
3j5 the information compression by means of an adaptive Huffman 
1 coding process including as many Huffman tables as the amount 

of predicted information. 

Preferably, the entropy coding circuit includes adaptive 

arithmetic coding circuit which has as many arithmetic tables 
2 0 as the amount of predicted information and which performs 

coding in accordance with an arithmetic table selected from the 

plurality of arithmetic tables. 

According to still another aspect of the present 

invention, to achieve the above object, there is provided a 
25 method of compressing motion image information, by means of 

comparing spatially or temporally adjacent pixels to each other 
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and outputting differential information thereby reducing 
redundant information between frames, the method including the 
steps of: comparing corresponding pixels to each other in each 
block consisting of n x m pixels (n and m are integers equal to 
or greater than 2) between frames and generating and storing a 
1-bit bit map indicating whether the absolute value of the 
difference thereof is greater or not greater than a given 
parameter; and compressing information of a pixel indicated as 
being greater than the parameter, the method of compressing 
image information being characterized in that: an image in each 
frame is divided into blocks in advance, and each of all blocks 
is approximated by (replaced with) a single plane defined by 
three data representing the magnitude of a pixel value in the 
block, the block-to-block gradient of the pixel value in an x 
direction, and the block-to-block gradient of the pixel value 
in a y direction. 

According to still another aspect of the present 
invention, to achieve the above object, there is provided a 
method of compressing motion image information, by means of 
comparing spatially or temporally adjacent pixels to each other 
and outputting differential information thereby reducing 
redundant information between frames, the method including the 
steps of: comparing corresponding pixels to each other in each 
block consisting of n x m pixels (n and m are integers equal to 
or greater than 2) between frames and generating and storing a 
l-bit bit map indicating whether the absolute value of the 
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difference thereof is greater or not greater than a given 
parameter; treating (deleting) information of a pixel, 
indicated as being no greater in the absolute value of the 
difference than the parameter, as a pixel having no difference 
5 between frames; and compressing information of a pixel 

indicated as being greater than the parameter, the method of 
compressing image information being characterized in that: an 
image in each frame is divided into blocks in advance, and each 

^ of all blocks is approximated by (replaced with) a single plane 
iO defined by three data representing the magnitude of a pixel 
value in the block, the block-to-block gradient of the pixel 

U value in an x direction, and the block-to-block gradient of the 

, pixel value in a y direction. 

s Lf Preferably, the 1-bit bit map information stored in the 

,J5 bit map is compressed by means of a binary image coding method 
q such as a r ^n length, modified READ (MR, MMR) , modified Huffman 
(MH) , or JBIG coding method. 

Preferably, information of a pixel indicated as being 
greater in the absolute difference value than the parameter is 
2 0 compressed by means of an adaptive Huffman coding process 

including as many Huffman tables as the amount of predicted 
information . 

According to still another aspect of the present 
invention, to achieve the above object, there is provided a 
25 system for compressing motion image information, including 
entropy coding circuit for reducing redundant information 
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between frames by means of comparing spatially or temporally 
adjacent pixels to each other and generating differential 
information, the system including: bit map information storage 
circuit for comparing corresponding pixels to each other in 
each block consisting of n x m pixels (n and m are integers 
equal to or greater than 2) between frames and generating and 
storing a 1-bit bit map indicating whether the absolute value 
of the difference thereof is greater or not greater than a 
given parameter; and information compression circuit for 
compressing information of a pixel indicated, by the bit map 
stored in the bit map information storage circuit, as being 
greater in the absolute difference value between pixels t and 
t-1 than the parameter, the system for compressing motion image 
information being characterized in that: an image in each frame 
is divided into blocks in advance, and each of all blocks is 
approximated by (replaced with) a single plane defined by three 
data representing the magnitude of a pixel value in the block, 
the block-to-block gradient of the pixel value in an x 
direction, and the block-to-block gradient of the pixel value 
in a y direction. 

According to still another aspect of the present 
invention, to achieve the above object, there is provided a 
system for compressing motion image information, including 
entropy coding circuit for reducing redundant information 
between frames by means of comparing spatially or temporally 
adjacent pixels to each other and generating differential 
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information, the system including: bit map information storage 
circuit for comparing corresponding pixels to each other in 
each block consisting of n x m pixels (n and m are integers 
equal to or greater than 2) between frames and generating and 
5 storing a 1-bit bit map indicating whether the absolute value 
of the difference thereof is greater or not greater than a 
given parameter; information compression circuit which treats 
(deletes) information of a pixel indicated, by the bit map 
^f- stored in the bit map information storage circuit, as being not 
iO greater in the absolute difference value between pixels t and 
M t-1 than the parameter, and which compresses information of the 
other pixels indicated as being greater in the absolute 
difference value than the parameter, the system for compressing 
„u motion image information being characterized in that: an image 
is in each frame is divided into blocks in advance, and each of 
j all blocks is approximated by (replaced with) a single plane 
defined by three data representing the magnitude of a pixel 
value in the block, the block-to-block gradient of the pixel 
value in an x direction, and the block-to-block gradient of the 
20 pixel value in a y direction. 

Preferably, The 1-bit bit map information stored in the 
bit map information storage circuit is information indicating 
the difference presence/absence for n x m blocks (n and m are 
integers equal to or greater than 2) in a frame and is 
2 5 compressed by means of a binary image coding method such as a 
run length, modified READ (MR, MMR) , modified Huffman (MH) , or 
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JBIG coding method. 

Preferably, the information compression circuit for 
compressing information of a pixel indicated as being greater 
in the absolute difference value than the parameter performs 
the information compression by means of an adaptive Huffman 
coding process including as many Huffman tables as the amount 
of predicted information. 

Preferably, the entropy coding circuit includes adaptive 
arithmetic coding circuit which has as many arithmetic tables 
as the amount of predicted information and which performs 
coding in accordance with an arithmetic table selected from the 
plurality of arithmetic tables. 

The method and system for compressing motion image 
information according to the present invention are 
characterized in that an image in each frame is divided into 
blocks in advance, and each of all blocks is approximated by J 
(replaced with) a single plane defined by three intensity data 
representing the magnitude of the intensity of the block, the 
block-to-block gradient of the intensity in the x direction, 
and the block-to-block gradient of the intensity in the y 
direction. 

Furthermore, corresponding pixels are compared with each 
other in each block consisting of n x m pixels (n and m are 
integers equal to or greater than 2) between frames, and 
differential information is generated according to the 
comparison result so as to reduce redundant information between 
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frames. That is, pixels t in a frame are compared with 
corresponding pixels t-1 in a previous frame, pixel by pixel, 
and 1-bit bit map is generated which indicates whether the 
absolute value of the difference is greater or not greater than 
a given parameter. 

In the entropy coding process, codes which will appear in 
successive frames are predicted, and small deviations from 
predicted codes are output thereby reducing the redundancy of 
information. The other information is compressed by means of 
adaptive Huffman coding or adaptive arithmetic coding in which 
coding is performed on the basis of a table selected from a 
plurality of tables in accordance with predicted information. 

Brief Description of the Drawings 

Fig. 1 is a block diagram schematically illustrating a 
process of compressing motion image information; 

Fig. 2 is a block diagram schematically illustrating a 
comparison process performed in accordance with information 
stored in bit map information storage circuit; 

Fig. 3 is a schematic diagram illustrating a coding 
process ; 

Fig. 4 is a schematic diagram illustrating a decoding 
process; 

Fig. 5 is a schematic diagram illustrating a coding 
process ; 



Fig. 6 is a schematic diagram illustrating a decoding 
process ; 

Fig. 7 is a schematic diagram illustrating a plane which 
is defined by three pixel parameters, the intensity, the 
5 gradient in an x direction, and the gradient in a y direction 
so as to approximate a divided image block; 

Fig. 8 is a plan view of an intraf rame- compressed image; 

and 

v3 Figs. 9A and 9B illustrate an interframe compression 

; :^0 process, wherein Fig. 9A is a plan view of a frame (t) and Fig. 
^ 9B is a plan view of a frame (t+1) . 

[ h Description of the Preferred Embodiment 

M$ The present invention is described in further detail below 

^ with reference to an embodiment in conjunction with the 

accompanying drawings. Fig. 1 is a block diagram schematically 
illustrating a process of compressing motion image information. 
A composite analog signal output from a device such as a video 

20 cameral, a disk player, or a video cassette player, according 
to the NTSC standard, is input to an analog- to-digital 
converter 1. The analog-to-digital converter 1 converts the 
applied analog signal to a digital signal representing one line 
of a video frame. The resultant digital signal is stored in a 

25 buffer 2. Although in the technique shown in Fig. 1 an analog 
signal output from the device according to the NTSC standard is 
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converted by the analog- to-digital converter 1 into a digital 
signal and stored in the buffer 2, the signal to be compressed 
according to the present invention is not limited to such a 
signal. That is, the technique according to the present 
invention can be used to efficiently compress any image signal 
output from a wide variety of devices. 

As shown in Fig. 1 or 2 , the compression encoder 3 
includes bit map information storage circuit a for comparing 
pixels t and corresponding pixels t-1 to each other between 
frames and generating and storing a 1-bit bit map indicating 
whether the absolute value of the difference thereof is greater 
or not greater than a given parameter P. The comparison between 
the pixels t and the pixels t-1 is performed in terms of their 
element (brightness or hue) . Herein, t denotes time. That is, 
pixels (pixels t) in a frame at a current time t are compared 
with corresponding pixels in a frame (pixels t-1 at locations, 
in the frame, corresponding to the locations of pixels t-1) at 
an immediately previous time t-1. The compression encoder 
further includes information compression circuit 5 which treats 
(deletes) information of a pixel indicated, by the bit map 
stored in said bit map information storage circuit 4, as being 
not greater in the absolute difference value between pixels t 
and t-1 than the parameter P, and which compresses information 
of the other pixels indicated as being greater in the absolute 
difference value than said parameter by means of adaptive 
Huffman coding using a Huffman table selected from as many 



- 17 - 



Huffman tables as the amount of predicted information. 
Furthermore, the compression encoder also includes entropy 
coding circuit 6 for reducing redundant information between 
frames by means of comparing spatially or temporally adjacent 
pixels to each other and generating differential information, 
wherein the entropy coding circuit includes adaptive arithmetic 
coding circuit which has as many arithmetic tables as the 
amount of predicted information and which performs coding using 
an arithmetic table selected from the plurality of arithmetic 
tables in accordance with the predicted information. 

The present embodiment is based on the intraframe 
compression in which the block size is fixed. That is, as 
shown in Fig. 7, an image in a frame is divided into blocks in 
advance, and each of all blocks is approximated (replaced) by a 
single plane which is defined by three data representing the 
magnitude of pixel value of the block, the block-to-block 
gradient of pixel value in the x direction, and the block-to- 
block gradient of pixel value in the y direction. That is, in 
the intraframe compression, an image is first divided into 
blocks, and then the divided blocks are replaced with a single 
plane for approximation. The plane is defined by three 
parameters z, x, and y associated with the pixel value in each 
block, wherein z is the intensity, x is the gradient in the x 
direction, and y is the gradient in the y direction. The 
approximation may be performed, for example, using the least 
squares method. The reduced (compressed) data obtained in the 
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above-described manner defines a plane which indicates 
gradation when being decompressed. Herein, if the number of 
pixels included in each block is equal to s, the intraframe 
compression ratio is given by 3/s. The intraframe compression 
5 ratio increases with s but the image quality becomes worse. 

The size and the shape of each block are selected arbitrarily, 
as long as each block consists of n x m pixels where n and m 
are integers equal to or greater than 2 . 

! As shown in Fig. 2, after completion of the encoding 

„iiO process, block data of each frame is sent to a memory 10 in the 
J bit map information storage circuit 4 and stored therein as 

previous -frame data for one frame period. Thereafter, the pixel 

- data stored in the memory 10 is filtered by a temporal filter 
11 serving as a time variable impulse response filter. After 

<C5 the filtering, the current frame data 13 and the previous frame 

^ data 14 are examined by the compression encoder in terms of 
redundancy between frames and the difference between them is 
calculated. That is, comparison circuit 12 compares the 
respective coded blocks with the block corresponding to the 

20 previous frame. Each block is added with a single-bit mark 

indicating whether the block is a new block or the same as the 
previous block. In this process, a frame bit map is produced 
such that each block is mapped by one bit. Herein, the bit 
maps of the respective frames are distinguished from each other 

2 5 by means of comparison between frames. 

The basic principles of the interframe compression used in 
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the present embodiment are described below. A first method of 
interframe compression is as follows. In a frame (t+1) 
following a current frame t, a block at the same location as 
that in the current frame is first subjected to the intraframe 
compression described above so as to obtain three parameters 
z(t + l), x(t + l), and y(t + l), where z is the intensity, x is the 
gradient in the x direction, and y is the gradient in the y 
direction. The root mean square error of z (t + 1) , x(t + l), and 
y(t+l) with respect to z(t+l), x(t+l), and y(t+l) is then 
calculated and compared with a threshold k. If the root means 
square error is greater than k, it is determined that there is 
a difference. Alternatively, when the respective differences 
between z(t+l) and z(t), x(t+l) and x(t), and y(t+l) and y(t) 
are compared with thresholds kz, kx, and ky, if any difference 
is greater than the threshold, it is determined that there is a 
difference. In the case where it is determined that there is a 
difference, the intraframe location of the block which has been 
detected to be different is descried in the form of a bit map. 
One bit map is generated in the former case and three bit maps 
are generated in the latter case. The bit map is a series of 
"0"s and lf l"s (binary data) and compressed by means of run 
length compression or the like. The difference data Az(t) = 
z(t + 1) -z(t), Ax(t) = x(t + 1) - x(t), and Ay(t) = y(t + 1) - 
y(t) are entropy- compressed. In this first method, 
decompression is not required, and thus the calculation can be 
performed in a short time. However, there is a possibility that 



calculation errors are accumulated. 

In a second interframe compression method, the data 
obtained by the above-described intraframe compression is first 
decompressed thereby reproducing the data of pixels in each 
5 block. After that, the root mean square error of the 

reproduced pixel data in each block of a frame (t+1) relative 
to the pixel data in the corresponding block of a previous 
frame t is calculated and compared with a threshold k. If a 
^ block having a root mean square error greater than the 
"10 threshold k is found, the block is determined to be different. 
■j In the case where it is determined that there is a difference, 
the intraframe location of the block which has been detected to 
be different is descried in the form of a bit map. The bit map 
:[i is a series of »0"s and "l"s (binary data) and compressed by 
15 means of run length compression or the like. The difference 
:j. data Az(t) = z(t + 1) -z(t), Ax(t) = x(t + 1) - x(t), and Ay(t) 
= y(t + 1) - y(t) are entropy-compressed. In this first 
method, decompression is performed, and thus a rather long 
calculation time is required. However, there is no possibility 
2 0 that calculation errors are accumulated. 

A third interframe compression method is described below. 
The root mean square error of the reproduced pixel data in each 
block of a next frame (t+1) relative to the pixel data in the 
corresponding block of a current frame (t) is calculated and 
25 compared with a threshold k. If the root mean square error is 
greater than k, it is determined that there is a difference. 
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In the case where a difference is detected, the difference AP 
between the pixel data in the block of the next frame (t+1) and 
the pixel data in the corresponding block of the current frame 
is determined. After that, the above-described intraframe 
5 compression is performed. The intraframe location of the block 
which has been detected to be different is descried in the form 
of a bit map. The bit map is a series of " 0 " s and "l"s (binary 
data) and compressed by means of run length compression or the 
^ like. The difference data AP is entropy- compressed. In this 
.IfiO third method, the compression is performed after determining 

whether there is a difference. Therefore, this method needs the 
™" least amount of calculation and calculation errors are not 
accumulated. 

\* The 1-bit bit map information stored in the bit map 

-IS information storage circuit 4 is compressed by a binary image 
•3 coding technique such as a run length, modified READ (MR, MMR) , 
modified Huffman (MH) , or JBIG method. In the case of a binary 
document image treated by a facsimile machine or the like, 
there is a high probability that white or black pixels 
2 0 successively appear in one or more continuous areas. Thus, in 
the run length coding method, one-dimensional segments called 
runs which include only white or black pixels are employed as 
units of coding, and the number of pixels included in each run, 
that is, the length of each run, is employed as a code. For 
25 example, in digital facsimiles using a public telephone 

network, a modified Huffman code is generally used in which the 
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run length model is established separately for black and white 
pixels . 

The modified Huffman coding (MH) is employed as a one- 
dimensional coding method in facsimile transmission in which an 
original image is scanned at a pixel density of, for example, 8 
pixels/mm thereby obtaining black-and-white pixel information 
including 1728 pixels per scanning line. The MH code represents 
the run length, that is, the length of each segment including 
only white pixels (white run) or only black pixels (black run) . 
Variable length codes are assigned to the respective runs using 
the statistical tendency that white or black runs having 
particular lengths occur more frequently than the other 
lengths, thereby reducing the amount of data. 

The modified READ (MR, MMR) method is widely used as a 
technique for performing two-dimensional coding in addition to 
the one-dimensional coding. In the NR method, up to one 
successive scanning line with the normal resolution or up to 
three successive scanning lines with the high resolution are 
two-dimensionally coded after being one-dimensionally coded. In 
the NMR method, the MR method is expanded for the infinite 
number of scanning lines for both the normal and high 
resolutions . 

The method and system for compressing motion image 
information according to the present invention are 
characterized in that pixels which are spatially or temporally 
adjacent are compared to each other, and differential 



information is generated thereby reducing redundant information 
between frames. That is, as shown in Fig. 2, pixels t in a 
frame are compared with corresponding pixels t-1 in a previous 
frame pixel by pixel, and a 1-bit bit map is generated and 
5 stored which indicates whether the absolute value of the 
difference thereof is greater or not greater than a given 
parameter P. The entropy coding circuit 6 predicts codes which 
will appear within a frame and in successive frames, 
; -;f respectively, and outputs small deviations from the predicted 
IjO codes thereby reducing the redundancy of information. Herein, 
■■j it is known that when an image signal is coded by means of code 
^ assignment and the coded signal is transmitted, the average 
* code length per pixel does not become equal to or less than the 

■ ^ average amount of information (entropy) . 

,15 The algorithm of the adaptive Huffman coding method is 

j described below. In the adaptive Huffman coding method, the 
predictive coding process including the generation of 
differential information and the Huffman coding is performed in 
one step thereby achieving an improvement in the codeword 

2 0 efficiency. In the conventional Huffman coding process, 

codewords are generally produced using a single Huffman table. 
In the dynamic Huffman coding, the Huffman table is updated 
each time one word is coded. In contrast, in the adaptive 
Huffman coding, there are as many Huffman tables (code tables) 

2 5 as the amount of predicted information, and a proper table is 
selected by a table selector from the plurality of tables. The 
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coding is performed using the selected table. Thus, data such 
as image information or audio information is compressed in a 
highly efficient manner by means of predictive coding. 
The algorithm of the adaptive arithmetic coding is 
5 described below. In the adaptive arithmetic coding, the 

predictive coding process including generation of differential 
information and arithmetic coding is performed in a single step 
thereby achieving an improvement in the codeword efficiency. 
■-■J In the conventional arithmetic coding, codewords are generally 
d":0 produced using a single occurrence probability table. In the 
U* dynamic arithmetic coding, the occurrence probability table is 
5 'i updated each time one word is coded. In contrast, in the 
~ - adaptive arithmetic coding, there are as many arithmetic tables 
j (decoding tables) as the amount of predicted information, and a 
; -£5 proper table is selected by a table selector from the plurality 
of tables. The coding is performed using the selected table. 
Thus, data such as image information is compressed in a highly 
efficient manner by means of predictive coding. 

In the adaptive conversion coding for a motion image, 
2 0 coding is performed after scaling the conversion factors by 
means of a feedback control in accordance with the filled 
factor of a transmission buffer memory. In this technique, in 
accordance with the histogram of conversion factors for a 
typical image, a threshold value for determining non- 
25 significant factors corresponding to signal values which are 
not coded, a run length code used to encode the continuity of 
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the non-significant factors, and a Huffman coding table used to 
encode the significant factors are determined, and coding is 
performed in accordance with them. In a specific predictive 
coding circuit, as shown in Figs. 3, 5, and 6, input image data 

5 31 which has been converted into a digital form by means of 

analog-to-digital conversion is applied to a table selector 33 
after being delayed at a delay circuit 32 . This image data is 
coded and compared with image data stored in code tables 34 at 
a table selector 33. The input image data 31 is directly 

0 applied to an encoder 35. The table selector 33 selects a code 
table from a plurality of code tables 34 in accordance with the 
predicted information and sends the selected code table to an 
encoder 35. The encoder converts the input image data 31 into 
an adjusted codeword as an output data 3 6 thereby compressing 

5 the input image data 31. 

Fig. 4 illustrates a specific example of a predictive 
decoding circuit. As shown in Fig. 4, a codeword as an input 
data 41 is sent to a decoder 42. The codeword 41 which has been 
sent directly to the decoder 42 is sent to a table selector 43 . 

0 The table selector 43 selects a decoding table from a plurality 
of decoding tables 44 in accordance with predicted information 
and sends the selected decoding table to the decoder 42 . The 
decoder 42 determines the difference with respect to the pixel 
value which has already been decoded, thereby obtaining 

5 adjusted image data as an output data 45. 

Now, a variable block size compression method is described 
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below with reference to Figs. 8, 9A and 9B. As described 
above, if the block size is increased, a greater compression 
ratio is obtained although the details of the original image 
are lost and the image quality becomes worse. In particular, 
5 when an original image consists of a background having a 

particular uniform color and a line having a small width and 
having an intensity which is very different from that of the 
background, there is a possibility that the line with the small 
width is completely lost. The above problem can be solved by 

.1:0 the technique described below. In the following description, 

;;f it is assumed for simplicity that an image is of monochrome and 

; ; : consists of 16 x 16 pixels. 

First, as shown in Fig. 8, the block size is set to 16 x 

-y : 16, and the whole image is intraf rame-compressed (decompressed) 

-25 according to the above-described method. Each pixel of the 

decompressed image is compared with the corresponding pixel of 
the original image, and the difference thereof is compared with 
a threshold dl . If there is a pixel whose difference is 
greater than dl, compression (decompression) is performed for a 

20 block with a size of 8 x 8 containing that pixel. In this 

compression (decompression) process, each of the remaining 8 x 
8 blocks in the same 16 x 16 block is also compressed. Each 
pixel of the decompressed image is compared with the 
corresponding pixel of the original image, and the difference 

25 thereof is compared with a threshold d2 . If there is a pixel 
whose difference is greater than d2 , compression 
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(decompression) is performed for a block with a size of 4 x 4 
containing that pixel. Also in this compression 
(decompression) process, each of the remaining 4x4 blocks in 
the same 8x8 block is also compressed. Each pixel of the 
5 decompressed image is compared with the corresponding pixel of 
the original image, and the difference thereof is compared with 
a threshold d3 . If there is a pixel whose difference is 
greater than d3 , compression (decompression) is performed for a 
block with a size of 2 x 2 containing that pixel. In this 
:iiO compression (decompression) process, each of the remaining 2 x 

2 blocks in the same 4x4 block is also compressed. This 
\,1 compression method makes it possible to achieve a high 

compression ratio without losing the details of the original 
image. 

•fi5 Interframe compression is further performed after the 

completion of the above-described intraframe compression. 
Herein, let us assume that compressed images shown in Figs. 9A 
and 9B are obtained for the frame (t) and the frame (t+1) , 
respectively, as a result of the intraframe compression 

2 0 described above. For areas 1 -> 1 ' and 2^2' having no change 
in block size, differences are calculated according to one of 
the methods described above and interframe compression is 
performed. For the area 4^4' in which an increase in block 
size occurs, the block in the area 4' is treated as a key block 

25 (key frame) which is not dependent upon the previous frame and 
which can be decompressed without needing the previous frame. 
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In this case, the difference calculation is not performed. For 
the area 3 -> 3 ' in which a reduction in block size occurs, the 
difference between the data of the frame (t+1) and the 
decompressed data of the frame (t) is calculated for each 
5 reduced block and compression is performed for each reduced 
block. 

As can be understood from the above description, the 
present invention has advantages as described below. That is, 
the elimination of the block conversion makes it possible to 

XO compress image information by means of predictive coding with a 
high compression ratio and at a high speed while maintaining 
high image and sound quality. In the present invention, unlike 
the conventional techniques in which a large difference between 
frames causes significant degradation in image quality, the 

:3J5 degradation in image quality is suppressed by treating 2x2 

q pixels as one block. That is, the present invention allows an 
intrablock threshold to be determined so that no significant 
degradation in image quality occurs and the image quality 
varies linearly. Thus, it becomes possible to easily adjust the 

2 0 communication bit rate without causing degradation in image 
quality. Besides, the compression ratio can be improved by 
about 20% to 50% without resulting in perceptible degradation 
in image quality. Furthermore, the adaptive Huffman 
compression process or the adaptive arithmetic compression 

2 5 process is performed in such a manner that the generation of 

differential information and the Huffman coding process, or the 
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generation of differential information and the arithmetic 
coding process are performed in one step thereby achieving 
highly efficient use of codewords and thus achieving highly 
efficient coding by means of predictive coding. 
5 More specifically, in the method of compressing motion 

image information according to an aspect of the present 
invention, including the steps of: comparing pixels in a frame 
with corresponding pixels in a spatially or temporally adjacent 
frame and generating differential information in accordance 
lp with the comparison result; generating and storing a 1-bit bit 
^ map indicating whether the differential information is greater 
r™ or not greater than a given parameter; and compressing 

information of a pixel indicated as being greater than the 
Vu parameter thereby reducing redundant information between 
E5 frames, the method is characterized in that: an image in each 
12 frame is divided into blocks in advance, and each of all blocks 
is approximated by (replaced with) a single plane defined by 
three data representing the magnitude of a pixel value in the 
block, the block-to-block gradient of the pixel value in an x 
20 direction, and the block-to-block gradient of the pixel value 
in a y direction, thereby allowing motion image information to 
be compressed in a highly efficient manner. 

In the method of compressing image information, according 
to another aspect of the present invention, by means of 
25 comparing spatially or temporally adjacent pixels to each other 
and generating differential information so as to reduce 
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redundant information between frames, the method including the 
steps of: comparing corresponding pixels to each other between 
frames and generating and storing a 1-bit bit map indicating 
whether the absolute value of the difference thereof is greater 
or not greater than a given parameter P; treating (deleting) 
information of a pixel, indicated as being no greater in the 
absolute value of the difference than the parameter P, as a 
pixel having no difference between frames; and compressing 
information of a pixel indicated as being greater than the 
parameter P, the method is characterized in that: an image in 
each frame is divided into blocks in advance, and each of all 
blocks is approximated by (replaced with) a single plane 
defined by three data representing the magnitude of a pixel 
value in the block, the block-to-block gradient of the pixel 
value in an x direction, and the block-to-block gradient of the 
pixel value in a y direction, whereby information to be 
compressed is limited and compressed in a highly efficient 
manner . 

In the method of compressing image information, according 
to another aspect of the present invention, by means of 
comparing spatially or temporally adjacent pixels to each other 
and generating differential information so as to reduce 
redundant information between frames, the method including the 
steps of: comparing corresponding pixels to each other between 
frames and generating and storing a 1-bit bit map indicating 
whether the absolute value of the difference thereof is greater 



or not greater than a given parameter P; and compressing 
information of a pixel indicated as being greater than the 
parameter P thereby reducing redundant information between 
frames, the method being characterized in that: an image in 
5 each frame is divided into blocks in advance, and each of all 
blocks is approximated by (replaced with) a single plane 
defined by three data representing the magnitude of a pixel 
value in the block, the block-to-block gradient of the pixel 
value in an x direction, and the block-to-block gradient of the 
pixel value in a y direction, thereby allowing motion image 

y*: information to be compressed in a highly efficient manner. 

^ In the method compressing image information, according to 

; still another aspect of the present invention, by means of 

comparing spatially or temporally adjacent pixels to each other 

£5 and generating differential information so as to reduce 

;.;] redundant information between frames, the method including the 
steps of: comparing corresponding pixels to each other between 
frames and generating and storing a 1-bit bit map indicating 
whether the absolute value of the difference thereof is greater 

2 0 or not greater than a given parameter P; treating (deleting) 

information of a pixel, indicated as being not greater than the 
parameter P, as a pixel having no difference between frames; 
and compressing information of a pixel indicated as being 
greater than the parameter P, the method of compressing image 

25 information being characterized in that: an image in each frame 
is divided into blocks in advance, and each of all blocks is 
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approximated by (replaced with) a single plane defined by three 
data representing the magnitude of a pixel value in the block, 
the block-to-block gradient of the pixel value in an x 
direction, and the block-to-block gradient of the pixel value 
5 in a y direction, thereby allowing motion image information to 
be compressed in a highly efficient manner. 

According to still another aspect, the present invention 
provides the system for compressing motion image information, 
^ including entropy coding circuit 6 for reducing redundant 

.£0 information between frames by means of comparing spatially or 

; • temporally adjacent pixels to each other and generating 
" differential information, the system including: bit map 

; information storage circuit 4 for comparing pixels t and 

corresponding pixels t-1 to each other between frames and 

i'S generating and storing a 1-bit bit map indicating whether the 

u absolute value of the difference thereof is greater or not 

greater than a given parameter P; and information compression 
circuit 5 for compressing information in the area indicated, by 
the bit map stored in the bit map information storage circuit 

2 0 4, as being greater in the absolute difference value between 
pixels t and t-1 than the parameter P. wherein the system is 
characterized in that an image in each frame is divided into 
blocks in advance, and each of all blocks is approximated by 
(replaced with) a single plane defined by three data 

25 representing the magnitude of a pixel value in the block, the 
block-to-block gradient of the pixel value in an x direction, 
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and the block-to-block gradient of the pixel value in a y 
direction, thereby allowing motion image information to be 
compressed in a highly efficient manner. 

According to still another aspect, the present invention 
5 provides the system for compressing motion image information, 
including entropy coding circuit for reducing redundant 
information between frames by means of comparing spatially or 
temporally adjacent pixels to each other and generating 
h * differential information, the system including: bit map 
iio information storage circuit 4 for comparing pixels t and 

corresponding pixels t-1 to each other between frames and 
-1 generating and storing a 1-bit bit map indicating whether the 
L::, absolute value of the difference thereof is greater or not 
f y. greater than a given parameter P; and information compression 
±5 circuit 5 for compressing information in the area indicated, by 
the bit map stored in the bit map information storage circuit 
4, as being greater in the absolute difference value between 
pixels t and t-1 than the parameter P, and for processing 
(deleting) pixels in the other area as those having no change 
2 0 between frames, wherein the system is characterized in that an 
image in each frame is divided into blocks in advance, and each 
of all blocks is approximated by (replaced with) a single plane 
defined by three data representing the magnitude of a pixel 
value in the block, the block-to-block gradient of the pixel 
25 value in an x direction, and the block-to-block gradient of the 
pixel value in a y direction, whereby information to be 
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compressed is limited and compressed in a highly efficient 
manner . 

The 1-bit bit map information stored in the bit map 
information storage circuit 4 may be compressed by means of a 
binary image coding method such as a run length, modified READ 
(MR, MMR) , modified Huffman (MH) , or JBIG coding method, 
thereby making it possible to compress image information in a 
highly efficient manner by means of predictive coding. This 
allows an improvement in image quality in digital facsimile 
transmission or the like using a public telephone network. 

In the information compression circuit 5 for compressing 
information in areas where the absolute difference values are 
greater than the given parameter P, information compression is 
performed by means of an adaptive Huffman coding process 
including as many Huffman tables as the amount of predicted 
information. The table selector selects a table from the 
plurality of tables in accordance with the predicted 
information, and coding is performed using the selected table. 
Thus it becomes possible to compress image information in a 
highly efficient manner by means of predictive coding. 

Furthermore, the entropy coding circuit 6 includes 
adaptive arithmetic coding circuit which has as many arithmetic 
tables as the amount of predicted information and which 
performs coding in accordance with an arithmetic table selected 
from the plurality of arithmetic tables. The table selector 
selects a table from the plurality of tables in accordance with 



the predicted information, and coding is performed using the 
selected table. Thus it becomes possible to compress image 
information in a highly efficient manner by means of predictive 
coding . 

5 According to still another aspect, the present invention 

provides the method of compressing motion image information, by 
means of comparing spatially or temporally adjacent pixels to 
each other and outputting differential information thereby 
reducing redundant information between frames, the method 
.Ip including the steps of: comparing corresponding pixels to each 
other in each block consisting of n x m pixels (n and m are 
integers equal to or greater than 2) , for example, 2x2 
pixels, between frames and generating and storing a 1-bit bit 
":i map indicating whether the absolute value of the difference 
-125 thereof is greater or not greater than a given parameter; and 
•j compressing information of a pixel indicated as being greater 
than the parameter P, wherein the method is characterized in 
that an image in each frame is divided into blocks in advance, 
and each of all blocks is approximated by (replaced with) a 
2 0 single plane defined by three data representing the magnitude 
of a pixel value in the block, the block-to-block gradient of 
the pixel value in an x direction, and the block-to-block 
gradient of the pixel value in a y direction, thereby allowing 
motion image information to be compressed in a highly efficient 
25 manner while maintaining high image and sound quality. 

According to still another aspect, the present invention 
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provides the method of compressing motion image information, by 
means of comparing spatially or temporally adjacent pixels to 
each other and outputting differential information thereby 
reducing redundant information between frames, the method 
5 including the steps of: comparing corresponding pixels to each 
other in each block consisting of n x m pixels (n and m are 
integers equal to or greater than 2) , for example, 2x2 
pixels, between frames and generating and storing a 1-bit bit 
map indicating whether the absolute value of the difference 

; 1]0 thereof is greater or not greater than a given parameter; and 
treating (deleting) information of a pixel, indicated as being 

' * no greater in the absolute value of the difference than the 

j parameter P, as a pixel having no difference between frames; 

and compressing information of a pixel indicated as being 

15 greater than the parameter P, wherein the method is 

characterized in that an image in each frame is divided into 
blocks in advance, and each of all blocks is approximated by 
(replaced with) a single plane defined by three data 
representing the magnitude of a pixel value in the block, the 

20 block-to-block gradient of the pixel value in an x direction, 
and the block-to-block gradient of the pixel value in a y 
direction, thereby allowing motion image information to be 
compressed in a highly efficient manner while maintaining high 
image and sound quality. 

2 5 Herein, the 1-bit bit map information may be compressed by 

means of a binary image coding method such as a run length, 
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modified READ (MR, MMR) , modified Huffman (MH) , or JBIG coding 
method, thereby making it possible to compress image 
information in a highly efficient manner by means of predictive 
coding. This allows an improvement in image and sound quality 
5 in digital facsimile transmission or the like using a public 
telephone network . 

Furthermore, for information in areas where the absolute 
difference values are greater than the given parameter P, 
\2 information compression is performed by means of an adaptive 
IJlO Huffman coding process including as many Huffman tables as the 
U amount of predicted information. The table selector selects a 
m table from the plurality of tables in accordance with the 
i& predicted information, and coding is performed using the 
rij selected table. Thus it becomes possible to compress image 
.is information in a highly efficient manner by means of predictive 
coding. 

According to still another aspect, the present invention 
provides the system for compressing motion image information, 
including entropy coding circuit 6 for reducing redundant 

2 0 information between frames by means of comparing spatially or 
temporally adjacent pixels to each other and generating 
differential information, the system including: bit map 
information storage circuit 4 for comparing corresponding 
pixels to each other in each block consisting of n x m pixels 

2 5 (n and m are integers equal to or greater than 2) between 

frames and generating and storing a 1-bit bit map indicating 
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whether the absolute value of the difference thereof is greater 
or not greater than a given parameter P; and information 
compression circuit 5 for compressing information in the area 
indicated, by the bit map stored in the bit map information 

5 storage circuit, as being greater in the absolute difference 
value between pixels t and t-1 than the parameter P. wherein 
the system is characterized in that: an image in each frame is 
divided into blocks in advance, and each of all blocks is 
approximated by (replaced with) a single plane defined by three 

0 data representing the magnitude of a pixel value in the block, 
the block-to-block gradient of the pixel value in an x 
direction, and the block-to-block gradient of the pixel value 
in a y direction, thereby allowing motion image information to 
be compressed in a highly efficient manner while maintaining 

5 high image and sound quality. 

According to still another aspect, the present invention 
provides the system for compressing motion image information, 
including entropy coding circuit 6 for reducing redundant 
information between frames by means of comparing spatially or 

0 temporally adjacent pixels to each other and generating 
differential information, the system including: bit map 
information storage circuit 4 for comparing corresponding 
pixels to each other in each block consisting of n x m pixels 
(n and m are integers equal to or greater than 2) between 

5 frames and generating and storing a 1-bit bit map indicating 

whether the absolute value of the difference thereof is greater 
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or not greater than a given parameter P; and information 
compression circuit 5 for compressing information in the area 
indicated, by the bit map stored in the bit map information 
storage circuit 4, as being greater in the absolute difference 
5 value between pixels t and t-1 than the parameter P, and for 
processing (deleting) pixels in the other area as those having 
no change between frames , wherein the system is characterized 
in that: an image in each frame is divided into blocks in 
~ : l advance, and each of all blocks is approximated by (replaced 
:li) with) a single plane defined by three data representing the 
"' [ magnitude of a pixel value in the block, the block-to-block 
'Z gradient of the pixel value in an x direction, and the block- 
to-block gradient of the pixel value in a y direction, thereby 
allowing motion image information to be compressed in a highly 
MS efficient manner while maintaining high image and sound 
\Z quality. 

Herein, the 1-bit bit map information stored in the bit 
map information storage circuit 4 s information indicating the 
difference presence/absence for n x m blocks (n and m are 

2 0 integers equal to or greater than 2) in a frame and is 

compressed by means of a binary image coding method such as a 
run length, modified READ (MR, MMR) , modified Huffman (MH) , or 
JBIG coding method, thereby making it possible to compress 
image information and audio information in a highly efficient 

25 manner by means of predictive coding. This allows an 

improvement in image quality in digital facsimile transmission 
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or the like using a public telephone network. 

In the information compression circuit 5 for compressing 

information in areas where the absolute difference values are 

greater than the given parameter P, information compression is 

performed by means of an adaptive Huffman coding process 

including as many Huffman tables as the amount of predicted 

information. The table selector selects a table from the 

plurality of tables in accordance with the predicted 

information, and coding is performed using the selected table. 

Thus it becomes possible to compress image information in a 

highly efficient manner by means of predictive coding. 

The entropy coding circuit 6 includes adaptive arithmetic 

coding circuit which has as many arithmetic tables as the 

amount of predicted information and which performs coding in 

accordance with an arithmetic table selected from the plurality 

of arithmetic tables. The table selector selects a table from 

the plurality of tables in accordance with the predicted 

information, and coding is performed using the selected table. 

Thus it becomes possible to compress image information in a 

highly efficient manner by means of predictive coding. 

Although only some exemplary embodiments of this invention 
have been described in detail above, those skilled in the art 
will readily appreciated that many modifications are possible 
in the exemplary embodiments without materially departing from 
the novel teachings and advantages of this invention. 
Accordingly, all such modifications are intended to be included 
within the scope of this invention. 

The disclosure of Japanese Patent Application No. 2000- 
334440 filed November 1, 2000 including specification, drawings 
and claims are herein incorporated by reference in its 



entirety. 
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